Method and apparatus for area-efficient graphical user interface

ABSTRACT

A user operates a GUI with a thumb and an index finger while holding an information processing device with left and right hands. The GUI screen image displays a directional keys input area at the lower left on the screen image, a button input area at the lower right on the screen image, an L 1 /L 2  button input area at the upper left on the screen image, and an R 1 /R 2  button input area at the upper right on the screen image. The L 1 /L 2  and the R 1 /R 2  button input areas are in the form of circle sectors, whereby the center angles of the circle sectors are at right angles of the two upper corners of the screen, and by internally dividing the center angles further so as to divide the sectors into two sectors respectively, the L 1  and L 2  buttons, and the R 1  and R 2  buttons are distinguished.

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional PatentApplication No. 61/441,337, filed Feb. 10, 2011, the entire disclosureof which is hereby incorporated by reference.

TECHNICAL FIELD

The present invention relates to an input device that receives anoperation input by a user using a hand, an information processingdevice, and an input-value-acquiring method used in those devices.

BACKGROUND ART

Recent years, compact size information devices that are assumed to betaken along, such as, portable type game devices, mobile phones, PDAs(Personal Data Assistances), or the like have become popular. For suchcompact size devices, input means are limited because of the sizelimitation. As a result, input means or functions specialized forcompact size devices have been developed in a unique way. For example,covering the surface of a display with a touch panel and allowing afinger or a touch pen to input give a user a feeling as if he/shedirectly operates an object or the like displayed on a display screen.

On the other hand, an environment for performing information processingusing such compact size devices at a similar level as that of gameconsoles or personal computers, is also getting ready. For example, byallowing a user to operate a compact size device and by allowing aconsole device connected with the compact size device via a network toperform actual information processing, it is becoming possible to enjoyan advanced type game regardless of the whereabouts of the user.Further, it is becoming possible, by emulating a game for a consoledevice, to play the game with a compact size device.

In this fashion, a technological direction, which allows a device toperform information processing such as a game or the like regardless ofthe size of the device or an environment in which the device is used,has been seen recent years. However, when attempting to perform suchhighly developed information processing by using a compact size device,a problem exists of poor operability resulted from the limitation oninput means as described above.

The present invention addresses the aforementioned issue, and a purposethereof is to provide a technology capable of implementing an inputmeans having favorable operability even with the limitation in its size.

SUMMARY OF THE INVENTION

According to an aspect of the present invention, an input device isprovided. The input device includes: a display device placed with aninformation processing device in a housing in an integrated fashion; anda touch panel covering the display, the input device convertinginformation on a point of contact with a finger or thumb of a hand thatis detected by the touch panel into an operation made by a user andallows the information processing device to process the operation,wherein the display device displays a GUI (Graphical User Interface)screen image as an on-screen display on an output image generated as aresult of information processing performed by the information processingdevice, GUIs being disposed in the GUI screen image in correspondencewith a position of an index finger and a thumb of a user when the userholds the housing from both sides so that an index finger and a thumbare placed on the upper surface of the display device, opposite a middlefinger that supports the housing from underneath.

According to another aspect of the present invention, an informationprocessing device is provided. The information processing deviceincludes: an information processing unit operative to performinformation processing in accordance with an operation made by a user; adisplay device operative to display an output image generated as aresult of information processing performed in the information processingdevice, the upper surface of the display device being covered by a touchpanel; and a housing operative to store the information processingdevice and the display device in an integrated fashion, wherein thedisplay device displays a GUI (Graphical User Interface) screen image asan on-screen display, GUIs being disposed in the GUI screen image incorrespondence with a position of an index finger and a thumb of a userwhen the user holds the housing from both sides so that an index fingerand a thumb are placed on the upper surface of the display device,opposite a middle finger that supports the housing from underneath, andthe information processing unit converts information on a point ofcontact with a finger or thumb of a hand on the GUI that is detected bythe touch panel into an operation made by a user and performsinformation processing.

According to yet another aspect of the present invention, an informationprocessing device is provided. The input value acquiring methodincludes: displaying a GUI (Graphical User Interface) on a displaydevice, which is placed with an information processing device in ahousing in an integrated fashion, as an on-screen display on an outputimage generated as a result of information processing; convertinginformation on a point of contact with a finger or thumb of a hand thatis detected by the touch panel covering the display device into anoperation on the GUI made by a user; and allowing an informationprocessing device to perform information processing in accordance withthe operation, wherein the displaying as an on-screen display displaysGUIs as an on-screen display by disposing the GUIs in correspondencewith positions of an index finger and a thumb of a user when the userholds the housing from both sides so that an index finger and a thumbare placed on the upper surface of the display device, opposite a middlefinger that supports the housing from underneath.

Optional combinations of the aforementioned constituting elements, andimplementations of the invention in the form of methods, apparatuses,systems, computer programs, or the like may also be practiced asadditional modes of the present invention.

According to the present invention, wide range of operations can beimplemented while keeping favorable operability even with a compact sizedevice.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an exemplary structure of a commonly used controller;

FIG. 2 shows an exemplary external view of an information processingdevice applying an input device according to an embodiment;

FIG. 3 shows the detailed structure of the information processing deviceaccording to the embodiment;

FIG. 4 shows an exemplary layout of GUIs in a GUI screen image accordingto the embodiment;

FIG. 5 is a diagram that illustrates an image to be displayed in a firstcombined GUI area and a detection area on a touch panel according to theembodiment;

FIG. 6 is a diagram that illustrates an image to be displayed in ajoystick input area and a manipulation method thereof according to theembodiment;

FIG. 7 shows a variation of the GUI screen image according to theembodiment;

FIG. 8 shows a variation of an L1/L2 button input area according to theembodiment;

FIG. 9 shows another exemplary layout of the GUI screen image and acontents screen image according to the embodiment;

FIG. 10 shows an exemplary configuration screen image of the displaymode of the GUI according to the embodiment.

DETAILED DESCRIPTION OF THE INVENTION

According to an embodiment, an input device in a compact sizeinformation device, such as, a mobile phone, a mobile terminal, or thelike is implemented. The input device has operability similar as that ofa controller of a game console, or the like. First, an explanation willbe given on an example of a commonly used controller. FIG. 1 shows anexemplary structure of a commonly used controller. A controller 120comprises directional keys 121, joysticks 127 a and 127 b, four-typeoperation buttons 126, L1/L2 buttons 130 a, and R1/R2 buttons 130 b, asoperation means for allowing a user to manipulate. The four-typeoperation buttons 126 comprise a circle button 122, a cross button 123,a square button 124, and a triangle button 125.

The directional keys 121 are configured so as to allow a user to key inone of four directions (up, down left and right), or eight directions(up, down left and right and four directions between the aforementionedfour directions), or to key in an arbitrary direction. For example, thedirectional keys 121 are used in order to move a cursor on a screenimage of a display device, or to scroll various types of information ona screen image. To the four-type operation buttons 126, functionsdifferent among buttons are respectively allocated by an applicationprogram.

The joysticks 127 a and 127 b comprise a stick supported so as to beable to tilt in an arbitrary direction, and a sensor that detects theamount of tilt. The stick is biased by a biasing means (e.g., a springor the like) towards a neutral position, and moves back to the neutralposition when not manipulated. The sensor includes a variable resister,that changes its resistance value in accordance with the tilt of thestick, and an A/D converter circuit that converts the resistance valueinto a digital value. If the stick is tilted, the amounts of tilt in aplurality of reference directions are converted into digital values,respectively, and the values are transmitted to a game device or thelike as operation signals.

The L1/L2 buttons 130 a and the R1/R2 buttons 130 b are configured withtwo buttons respectively, namely, an L1 button and an L2 button, and anR1 button and an R2 button. In both combinations, two buttons aredisposed at an upper position and a lower position respectively on theside surface of the controller 120. For example, a button is used inorder to change the direction of line of sight in a game, or used inorder to add a different movement when the button is manipulatedconcurrently with another button. However, various functions areallocated also to these buttons by an application program.

A user holds a left grip 128 a by the left hand and a right grip 128 bby the right hand, and manipulates the controller 120. The directionalkeys 121, the joysticks 127 a and 127 b, and the four-type operationbuttons 126 are provided on the top surface of the controller 120 sothat the user can manipulate them while holding the left grip 128 a andthe right grip 128 b by the left and right hands, respectively. TheL1/L2 buttons 130 a and the R1/R2 buttons 130 b are provided on asurface positioned at the other side of the left grip 128 a and theright grip 128 b so that the buttons can be manipulated by the indexfingers of the left and right hands.

According to an embodiment, each operation means included in thecontroller shown in FIG. 1 is re-created on a plane surface as a GUI. Anexplanation will be given below on an input device according to theembodiment. FIG. 2 shows an exemplary external view of an informationprocessing device applying the input device according to the embodiment.The information processing device 10 is a compact size device that canbe carried by a user, and may be any one of a mobile phone, a PDA, aportable type game device, or the like. Alternatively, the informationprocessing device 10 may be provided with a function, which is acombination of the functions of those devices. Therefore, theinformation processing device 10 may comprise various processingmechanisms in accordance with the functions. However, an explanationthereon will be omitted as appropriate since commonly used technologiescan be applied thereto.

The information processing device 10 is provided with a configurationwherein a display 14 is placed on the front face of the main body and anactivation switch 40 is placed on a side face. At the back side of thedisplay 14, mechanisms required for a variety of types of informationprocessing, such as, a CPU, a graphics processor unit, a soundprocessor, a memory, or the like are embedded (not shown). The display14 may be any one of commonly used displays, such as, a liquid crystaldisplay, an EL (electroluminescent) display, a plasma display, or thelike. The top surface of the display 14 is covered with a touch panel12. The touch panel 12 is implemented by any one of methods put intopractical use, such as, a resistive type, an optical type, or acapacitive type.

In addition, the information processing device 10 may comprise a speakerfor outputting sounds, an ear phone connecting terminal, an infraredport or wireless LAN mechanism for communicating with other devices, abattery box, or the like. However, those elements are not shown in FIG.2.

On the display 14, a screen image that is necessary to allow an user toinput an operation (e.g., a menu screen image, an icon, or the like), ascreen image resulted from information processing (e.g., a game screenimage, a moving image play back screen image, a text displaying screenimage, a photograph displaying screen image, or the like) are displayedin accordance with a function. Further, a GUI (Graphical User Interface)for allowing a user to input an operation while watching such an imageis displayed as an on-screen display.

The user inputs an operation into the information processing device 10by touching the touch panel 12 by a thumb or a finger of a hand, or bysliding a thumb or a finger of a hand on the touch panel 12 as if he/shemanipulates the GUI. In FIG. 2, a directional keys input area 42 thatdisplays a graphic of the directional keys, and a button input area 44that displays a graphic of the four-type operation buttons (i.e., thecircle button, the cross button, the square button, and the trianglebutton) are equipped as the GUI. In FIG. 2, dashed lines surrounding thedirectional keys input area 42 and the button input area 44 are merelyfor illustrating of the boundaries of the areas and thus do not relateto actual displaying or functions. The same applies to the followingfigures.

For example, when selecting a desired item in a menu screen, first, auser moves an item targeted to be displayed with emphasis included inthe names of items or icons displayed as a list by touching one of thedirectional keys in the directional keys input area 42 and confirms theitem by touching the circle button in the button input area 44. Further,the user changes the direction of movement of a character appearing in agame by touching one of the directional keys in the directional keysinput area 42. Alternatively, in a interactive type game, the userindicates the intention, for example “yes” by touching the circlebutton, or “no” by touching the cross button.

In this manner, an input operation implemented by providing thedirectional keys input area 42 and/or the button input area 44 can bechanged in a various ways by allocating buttons in accordance withrespective functions implemented by the information processing device10. According to the embodiment, by re-creating an input means of a gameconsole or a personal computer in a touch panel style, a variation ofinput operations in compact size information devices can be diversifiedas much as that of a game console or the like.

In addition, a game, which a user accustomed to play with a gameconsole, can be also played with a compact size information device bysimilar operability without bringing discomfort to the user. Theillustrated shapes or the marks of the directional keys input area 42 orthe button input area 44 are merely shown as examples, thus the shapesor the marks are not intended to be limited to those shown in FIG. 2.The directional keys input area 42 or the button input area 44 can bereplaced by other input means as appropriate in accordance with acontroller intended to be re-create.

FIG. 3 shows the detailed structure of the information processing device10. In addition to the touch panel 12 and the display 14 describedabove, the information processing device 10 includes a contents storage16, a GUI image storage 18, an input/output control unit 20, anoperation information converting unit 22, a contents processing unit 24,a GUI image generating unit 26, a GUI image buffer 28, a contents imagegenerating unit 30, a contents image buffer 32, and an imagesynthesizing unit 34. The contents storage 16 stores programs ofcontents and/or various types of data. The GUI image storage 18 storesdata of clip art graphics provided as a GUI. The input/output controlunit 20 controls the reception of a signal input from the touch panel 12and/or input/output of image data. The operation information convertingunit 22 converts the signal input from the touch panel 12 to informationon operation details. The contents processing unit 24 processes contentsin accordance with the operation details. The GUI image generating unit26 generates an image of a GUI. The GUI image buffer 28 stores thegenerated image of the GUI temporarily. The contents image generatingunit 30 generates an image of the contents. The contents image buffer 32temporarily stores the generated image of the contents. The imagesynthesizing unit 34 generates an image wherein the GUI image isdisplayed as an on-screen display on the image of contents.

The elements depicted in FIG. 3 as functional blocks for performingvarious processes are implemented in hardware such as a CPU, memory, orother LSI's, and in software such as a programs that process contents orperforms image processing, etc. Therefore, it will be obvious to thoseskilled in the art that the functional blocks may be implemented in avariety of ways, by hardware only, software only, or a combinationthereof.

The input/output control unit 20 is connected with the touch panel 12,the display 14, the contents storage 16, and the GUI image storage 18 byusing an existing method, and controls input/output of data. An inputsignal received from the touch panel 12 is the coordinates of a contactpoint on which the user has touched in the touch panel 12, the movementpathway of the coordinates when the contact point moves continuously, orthe like. Since a method for detecting the contact points on the touchpanel 12 differs depending on the type of the panel, no reference ismade to the method. Further, the input/output control unit 20 outputs avideo signal of a display image to the display 14.

Further, the input/output control unit 20 accesses to the contentsstorage 16 and reads out a program or a variety of types of datarequired for processing of the contents. Further, the input/outputcontrol unit 20 accesses to the GUI image storage 18 and reads out thedata of clip art graphics of the directional keys, the buttons, or thelike described above. The types of “contents” is not limited providedthat the contents can be processed and represented by a computer, suchas a computer game, a movie, a piece of music, a novel, a photograph, orthe like. The embodiment can be applicable to general informationprocessing, such as, communication, schedule management, an addressbook, a spreadsheet, or the like, in addition to general “contents.” The“contents” in the following explanation includes all of theaforementioned contents.

The contents storage 16 stores, in case that the contents is of a game,information on a program thereof, information on a player, a levelachieved when the game is played last time, or the like. In case thatthe contents is of a movie or music, the contents storage 16 stores,compressed and encoded video data, audio data, a program for decodingand playing back the data, or the like. The contents storage 16 may be ahard disk drive or may be a combination of a removable recording medium(e.g., a memory card, a ROM disk, an optical disk, a magneto-opticaldisk, or the like) and a reader thereof.

The GUI image storage 18 is a storage (e.g., a hard disk drive or thelike) that stores image data that can be used as a clip art graphics ofthe GUI image, such as the directional keys, the variety of types ofbuttons, or the like. As will be described later, an image of the GUIitself may be changed as a result of an operation on the GUI, accordingto the embodiment. Therefore, the GUI image storage 18 stores image datacorresponding to such wide-ranging variations of GUIs.

The operation information converting unit 22 acquires a signal inputthrough the touch panel 12 from the input/output control unit 20 andconverts the coordinates of the contact point or the like included inthe signal into information on operation details. As described above,according to the embodiment, a GUI itself may be changed as a result ofan operation on the GUI. Therefore, the correspondence between the typeof a GUI and a position to display the GUI is stored inside, in advance.Then, based on the acquired coordinates of the contact point and thetype of a GUI being displayed currently, operation details intended by auser (e.g., the type of a pushed button, the degree and/or the directionof the operation, or the like) are identified.

The information on the operation details are notified to the contentsprocessing unit 24 and the GUI image generating unit 26, respectively.The contents processing unit 24 performs, according to a program storedby the contents storage 16, a process required to proceed a game, or toplay back a moving image and/or music in accordance with the operationdetails. An actual processing procedure is as similar as that performedcommonly in accordance with the details of contents.

The GUI image generating unit 26 generates a new image of a GUI as needarises based on the operation details and stores the image into the GUIimage buffer 28. Although specific examples of the change of an GUIimage will be given later, for example, colors are changed or a buttonis shown as if it is pushed, so as to indicate that a user has contactwith the touch panel, or a key and/or a button itself is replaced withthat of another GUI.

Therefore, the GUI image generating unit 26 stores information thatassociates the operation details and a change to be made in an image, anidentification information of an image to be newly used, or the like,inside. Then the GUI image generating unit 26 reads out image data of anecessary GUI from the GUI image storage 18 as appropriate, andgenerates data of a new on-screen image, so that a change associatedwith an operation that has been made on a GUI being displayed currently,is represented.

Depending on the operation details, in case a GUI does not need to bechanged, the GUI image generating unit 26 does not have to perform aprocess of generating a new image. The contents image generating unit 30generates data of an image to be output as a result of processingperformed by the contents processing unit 24, and stores the data intothe contents image buffer 32, accordingly.

By performing rendering processing using image data stored in the GUIimage buffer 28 and image data stored in the contents image buffer 32,the image synthesizing unit 34 generates an image wherein a GUI image isdisplayed as an on-screen display on the image of contents and storesthe image into an internal frame buffer, accordingly. By allowing avideo signal corresponding to the image stored in the frame buffer to betransmitted to the display 14 under the control of the input/outputcontrol unit 20, an image corresponding to a GUI operation made by auser is displayed on the display 14.

Next, a specific example of the GUI screen image according to theembodiment will be presented. According to the embodiment, a GUI screenimage is displayed as an on-screen display on a contents screen image,such as a game, or the like. Therefore, it is important to be able toacquire operability similar as that of a controller of a game console,or the like, without hindering the contents screen image.

According to the embodiment, a joystick is re-created as a GUI inaddition to directional keys and four-type operation buttons. In thisprocess, by configuring the re-created joystick to allow a user to inputan arbitrary direction and an arbitrary quantity in a similar mannerwith that of an original joystick, the user can use either the joystickor the directional keys according to circumstances when instructing adirection in a similar manner with that of an original controller. ThisGUI makes an input of an arbitrary direction and an arbitrary quantitypossible, and can be used for controlling the moving direction and/orthe moving speed of a character appearing in a game, turning of a fieldof view, or the like. In the following explanation, an input made via apseudo-joystick, which is represented as a GUI, is also referred to as a“joystick input”.

If the three types of GUI described above, or more than three GUIs aredisposed on a GUI screen image just as they are, the GUIs may hinder thevisibility of a contents screen image. Therefore, according to theembodiment, by providing a combined GUI area that is a combination of aplurality of GUIs, the plurality of GUIs share a same detection area.Depending on the position of a contact point in the combined GUI areawhen a user newly touches the area, the entirety of the combined GUIarea is determined to be used as which of the GUIs.

FIG. 4 shows an exemplary layout of the GUIs in a GUI screen image. AllGUI screen images 50 a, 50 b, 50 c, 50 d, and 50 e are a screen imagethat is displayed as an on-screen display on an image of contents on thedisplay 14. An operation made by a user switches the screen image to bedisplayed between the GUI screen image 50 a, and one of the GUI screenimages 50 b, 50 c, 50 d, and 50 e. The GUI screen image 50 a is astandard screen image, and displays a first combined GUI area 52 and asecond combined GUI area 56 at the lower left and at the lower right onthe screen image, respectively.

The first combined GUI area 52 is an area for a GUI that is acombination of a GUI of the directional keys and a GUI of a joystick,and has a same design with that of the directional keys input area 42shown in FIG. 2. The first combined GUI area 52 is configured with adirectional keys graphic 51 that is at least a part of a graphic of theGUI of the directional keys, and a joystick graphic 53 that isrepresented by a figure (e.g., a circle or the like) at the center ofthe directional keys graphic 51 and that is at least a part of a graphicof the GUI of the joystick.

The second combined GUI area 56 is an area for a GUI that is acombination of a GUI of the four-type operation buttons and a GUI of ajoystick, and has a same design with that of the button input area 44shown in FIG. 2, in a similar manner with that of the first combined GUIarea 52. The second combined GUI area 56 is configured with an operationbutton graphic 55 that is at least a part of a graphic of the GUI of thefour-type operation buttons and a joystick graphic 57 that isrepresented by a figure (e.g., a circle or the like) at the center ofthe operation button graphic 55, and that is at least a part of thegraphic of the GUI of the joystick.

On the GUI screen image 50 a, which is a standard screen image, if auser newly touches the joystick graphic 53 of the first combined GUIarea 52, a process of receiving an input through the joystick isstarted, and the first combined GUI area 52 is switched to a joystickinput area 58 that does not include a directional keys graphic 51 (GUIscreen image 50 b). More specifically, the process is performed by acontinuous motion, i.e., if the user puts a thumb or a finger on thejoystick graphic 53 of the first combined GUI area 52, the area isswitched to the joystick input area 58, and by sliding the thumb or thefinger on the touch panel without detaching it, the moving direction andthe moving distance of the thumb or the finger is acquired as an inputvalue.

During a time period when the thumb or the finger remains touchingcontinuously, the area works as the joystick input area 58 and acquiresan input value from the movement of the thumb or the finger,sequentially. If the user detaches the thumb or the finger, the areaswitches back to the first combined GUI area 52 (GUI screen image 50 a).

On the other hand, on the GUI screen image 50 a, if a user newly touchesthe directional keys graphic 51 of the first combined GUI area 52, aprocess of receiving an input through the directional keys is started,and the first combined GUI area 52 is switched to a directional keysinput area 42 (GUI screen image 50 c). Also in this case, during a timeperiod when the thumb or the finger remains touching continuously, thearea works as the directional keys input area 42 and receives an inputvia the directional keys, and when the user detaches the thumb or thefinger, the area switches back to the first combined GUI area 52 (GUIscreen image 50 a).

However, the joystick graphic 53 may be kept displayed also in thedirectional keys input area 42 so that the first combined GUI area 52and the directional keys input area 42 appear similarly as shown in FIG.4. This eliminates the inconvenience of a disappearance and reappearanceof the joystick graphic 53 even when the directional keys are touched ina discontinuous manner for inputs via the directional keys.

The second combined GUI area 56 also works in a similar manner, i.e., ifa user newly touches the joystick graphic 57, a process of receiving aninput through the joystick is started, and the area is switched to thejoystick input area 58 that does not include a four-type operationbutton graphic 55 (GUI screen image 50 d), and if the thumb or thefinger is detached, the area switched back to the second combined GUIarea 56 (GUI screen image 50 a). While the thumb or the finger remainstouching, the area works as the joystick input area 58 and tracks themovements of the thumb or the finger.

On the other hand, if a user newly touches the four-type operationbutton graphic 55 of the second combined GUI area 56, a process ofreceiving an input through the buttons is started, and the secondcombined GUI area 56 is switched to the button input area 44 (GUI screenimage 50 e). Then if the user detaches the thumb or the finger, the areaswitches back to the second combined GUI area 56 (GUI screen image 50a). Also in this process, the joystick graphic 57 may be kept displayedin the button input area 44 for the same reason with that of thedirectional keys input area 42.

In this manner, by enabling switching between the directional keys inputarea 42 and the joystick input area 58, and between the button inputarea 44 and the joystick input area 58, respectively, the size of anarea occupied by a GUI image can be reduced. As a result, even whendisplayed as an on-screen display, hindrance to a contents screen imageis small, and the contents screen image and a GUI can coexist in alimited space. Further, viewing that a stick is tilted in a desireddirection while setting the center as a starting point in case of anactual joystick, by associating the motion of sliding a thumb or afinger from the center of an area with the activation of an input viathe joystick, an action required for switching is natural.

Further, by configuring both of the first combined GUI area 52 at thelower left and the second combined GUI area 56 at the lower right to beswitchable to the joystick input area 58, a combination of input meansthat are displayed concurrently can be changed, or a hand to be used foroperation (i.e., a left hand or a right hand) can be determined in aflexible and prompt manner, depending on the type of contents, thedetails or a scene of a game, or the like.

In the above example, the GUIs of the directional keys input area 42 andthe button input area 44 are sufficiently implemented by a GUI foron/off input that switches a function provided for each button to be onor off through contact or non-contact with a separated region thatrepresents a commonly used button. Thus, the GUIs are not intended to belimited to direction instruction keys, a circle button, a cross button,a square button, and a triangle button. The GUI of the joystick inputarea 58 is also sufficiently implemented by a GUI for analogue inputthat receives an analogue value in accordance with a contact position ina certain area, and thus not intended to be limited to the function ofjoystick.

In either case, a GUI for on/off input and a GUI for analogue input arecombined into a combined GUI. In the combined GUI, the graphic of theGUI for on/off input is displayed without change and an instruction forswitching to the GUI for on/off input is received. Concurrently, adetection area for switching to the GUI for analogue input is defined asa small area, and the detection area is expanded after switching. Thisenables a switching operation from the combined GUI to respective GUIsand an operation on the respective GUIs to be performed naturally in aflow of a series of operations. In this process, when switching to theGUI for on/off input, the graphic for switching to the GUI for analogueinput, which has been displayed on a part of the combined GUI, is keptdisplayed. This eliminates the inconvenience of a disappearance and areappearance of the graphic during a time period when the GUI for on/offinput is operated in a discontinuous manner.

In addition, a switching button 54 may be displayed on the GUI screenimage 50 a. Making contact with this switching button 54 may allow abutton that has not been displayed (e.g., a button required inaccordance with a function, such as, a select button for selecting amenu item, a start button for starting to play back a moving image,music, or the like) to appear from the bottom of the screen image. Byconfiguring the embodiment in this manner, a button that is less usedcan be hidden and the contents screen image can be configured so as tobe easily viewable.

FIG. 5 is a diagram that illustrates an image to be displayed in a firstcombined GUI area 52 and a detection area on a touch panel. The leftpart of FIG. 5 is an image of the first combined GUI area and the rightpart is an image wherein detection areas are shown on the image. Thefirst combined GUI area 52 is configured with a circle 60, directionalkeys graphic 62 comprising four keys indicating four directions (up,down, left, and right) that are disposed on the circumference of thecircle 60, and a joystick graphic 53 disposed at the center of thecircle 60.

The circle 60 to be displayed on the first combined GUI area 52 is alsodisplayed in the directional keys input area 42 and is for representinga sense of togetherness of the set of four keys two dimensionally, whichan original controller can present by its three dimensional shape. Bydisplaying such a circle, even when an image of contents displayed as abackground is less tidy, the set of keys can be easily perceived as aGUI.

The circle 60 is configured to be capable of being displayed in apartially translucent manner, so that the circle does not block thecontents screen image. The transmittance is configured so that the usercan define the transmittance while taking the types of contents, or thelike into account. By displaying a similar circle also in the secondcombined GUI area 56 and in the button input area 44, a sense oftogetherness as a set is represented. The arrangement of colors of thedirectional keys or the four-type operation buttons is preferably amonotone base so as to prioritize colors of an image on the contentsscreen image.

The four keys of the directional keys graphic 62 are respectivelyassociated with rectangular detection areas 64 a, 64 b, 64 c, and 64 dof predetermined size that surround graphic symbols of respective keyson the touch panel. Further, the joystick graphic 53 is associated witha detection area 68 positioned at the center of the circle 60. Bydefining the shape of the detection areas 64 a, 64 b, 64 c, and 64 d asa shape that can be defined by a mathematical expression (e.g., atriangle, a circle, or the like, besides the rectangle), the areas canbe readily associated with the display of keys, regardless of theresolution of the display and/or the touch panel.

Further, by setting the size of the detection areas 64 a, 64 b, 64 c,and 64 d on the large side so as to include areas surrounding graphicsymbols of respective keys, an operation can be detected even if a pointof contact with a thumb or a finger is slightly deviated from the key,and concurrently, overlapping areas 66 a, 66 b, 66 c, and 66 d can beprovided for adjacent detection areas. These overlapping areas 66 a, 66b, 66 c, and 66 d are associated with four diagonal directions, that aremid directions of four directions, i.e., up, down, left, and right. Thisdoubles the number of directions that can be input in comparison withthe case where only a part of each key is set as a detection area, thusallows a user to instruct a direction in multi levels.

In case of the directional keys input area 42, detections areascorresponding to the directional keys are defined in a similar mannerwith that shown in FIG. 5. However, an area for detecting whether or nota user remains touching continuously, which is a criterion whenswitching from the directional keys input area 42 back to the firstcombined GUI area 52, is determined separately, for example as apredetermined concentric circle having a radius equal to or larger thanthat of the circle 60. This avoids, in case that a thumb or a finger ofa user who is entering information through the directional keys movesvia the center portion of the directional keys input area 42, movingback to the first combined GUI area 52 despite the user's intention, orswitching back to the joystick input area 58. In case that a contactpoint departs from the detection area, the directional keys input area42 is switched to the first combined GUI area 52.

FIG. 6 is a diagram that illustrates an image to be displayed in ajoystick input area 58 and an operation method thereof. As describedabove, the joystick input area 58 is displayed during a time period whena user slides a thumb or a finger on the touch panel without detachingfrom the panel, after touching the detection area 68 of the joystickgraphic 53 of the first combined GUI area 52 or the like. In thisprocess, as shown in the left part of FIG. 6, an indicator 70 (e.g., acircle or the like) is displayed at the position where the thumb or thefinger 76 of the user touches. The indicator 70 has preferably a sizeand shape so as not to be hidden by the thumb or the finger. Theindicator 70 will be furthermore easily perceivable by applying asparkling image processing to an area surrounding the indicator, byshifting the position slightly so as to track the movement of thecontact position, or by displaying the trail faintly.

The indicator 70 moves in accordance with the movement of the point incontact with the thumb or finger 76. Also in the joystick input area 58,a circle 72 having the same radius is displayed at the same positionwith the circles displayed in the first combined GUI area 52, the secondcombined GUI area 56, the directional keys input area 42, and the buttoninput area 44. Since joystick graphics are provided in the firstcombined GUI area 52 and the second combined GUI area 56 in theircentral portions, the center of the circle is located at a positionwhere a user first touches for a joystick input. Further, as shown inthe right side of FIG. 6, the detection area 79 is defined as aconcentric circle having a radius equal to or larger than that of thecircle 72. If the contact point departs from the detection area 79, thearea is switched back to the original first combined GUI area 52 or backto the second combined GUI area 56.

As is obvious from FIG. 5 and FIG. 6, the detection area 79 thatreceives a joystick input in the joystick input area 58 is an area,which is a concentric expansion of the detection area 68 for switchingto the joystick input area 58 in the first combined GUI area 52. Thesame is applied to the relationships between a detection area forswitching to the joystick input in the second combined GUI area 56 and adetection area after the switching.

The circle 72 may be displayed in a partially translucent manner, or maynot be displayed. In the joystick input area 58, the coordinates of thecontact point 78 is acquired continuously in predetermined timeintervals, and a direction vector from the center of the circle 74 ofthe detection area 79 to the contact point 78 is set as an input valuefor each time point. The time interval for acquiring the coordinates isdefined, for example, shorter than the time interval for displayingframes on the display 14.

The operation information converting unit 22 stores therein informationthat associates the direction from the center of the circle 74 to thecontact point 78 of a direction vector and a tilting direction of anoriginal joystick with each other, and the distance from the center 74to the contact point 78 and a tilting quantity of the original joystickwith each other. By referring the information, the operation informationconverting unit 22 converts a direction vector of each time point into atilting direction and a tilting quantity of the original joystick, andnotifies the contents processing unit 24 thereof. This enables contentsprocessing unit 24 to perform processing in a similar manner with a casewhere an input is made through an original joystick. Alternatively, thedirection or the distance may be directly used to process contents.

If the contact point reaches the circumference of the circle 72, aninput value to be obtained is defined as an input value for a maximallytilted joystick. If the contact point departs from the circle 72,provided that the contact point is within the range of detection area79, only the direction from the center of the circle 74 is acquired inaccordance with the contact point, and the distance is defined to becomesaturated at the radius of the circle 72, regardless of the contactpoint. In this process, the indicator 70 is displayed so as to move inaccordance with the direction of the contact point on the circumferenceof the circle 72. In this manner, by providing the joystick input area58, an input means having a small difference in an operation method andoperability with an original joystick can be implemented on a planesurface. Further, by disabling the displaying of the circle 72, or bydisplaying the circle 72 in a partially translucent manner, an effect ona contents image screen can be minimized while an arbitrary directionand an arbitrary quantity can be input.

FIG. 7 shows a variation of the GUI screen image. A GUI screen image 50f of the information processing device 10 in FIG. 7 includes a firstcombined GUI area 52 at the lower left on the screen image and a secondcombined GUI area 56 at the lower right on the screen image, in asimilar manner with the GUI screen image 50 a shown in FIG. 4. The GUIscreen image 50 f further includes an L1/L2 button input area 80 at theupper left on the screen and an R1/R2 button input area 82 at the upperright on the screen. The L1/L2 button input area 80 is configured so asto include buttons corresponding to the L1 button and the L2 buttonshown in FIG. 1. The R1/R2 button input area 82 is configured so as toinclude buttons corresponding to the R1 button and the R2 button shownin FIG. 1.

According to the embodiment, it is assumed that a user operates a GUIwith a thumb or a finger of the left and right hands 84 while holdingthe main body of the information processing device 10 with the left andright hands 84 as shown in FIG. 7. Therefore, disposing the firstcombined GUI area 52 and the second combined GUI area 56 at the lowerleft and at the lower right on the screen image allows a thumb tomanipulate the areas.

Further, disposing the L1/L2 button input area 80 and the R1/R2 buttoninput area 82 at the upper left and at the upper right on the screenimage as shown in FIG. 7 allows an index finger to manipulate. AlthoughFIG. 7 shows the information processing device 10 and the hands 84separately so that the GUI screen image 50 f is easily viewed, whenholding the device in practice, thumbs and index fingers are positionedon the GUI screen image 50 f.

By laying out the GUIs in this manner, a user can operate theinformation processing device 10 without distortion while holding thedevice, and in addition, the user can operate two areas or more than twoareas of four areas concurrently. The L1/L2 button input area 80 and theR1/R2 button input area 82 are formed in the shape of circle sectors,whereby the center angles of respective circle sectors are the rightangles of the two upper corners of the screen, and internally dividingthe center angles so as to divide the sectors into two sectorsrespectively enables the discrimination between the L1 button and the L2button, and between the R1 button and the R2 button, as shown in FIG. 7.

In case of holding the information processing device 10 in the shape asshown in FIG. 7, the bases of the index fingers of the hands 84 istypically placed opposite the middle fingers so as to form shapes forpinching the housing of the information processing device 10. Therefore,ranges where the index fingers can operate the touch screen withoutdistortion are in the shapes of circle sectors, which are formed bybending upper parts from joints of the index fingers. By defining theshapes of the L1/L2 button input area 80 and the R1/R2 button input area82 as circle sectors, a user can touch the L1/L2 button and the R1/R2button in a distinguishable manner by merely changing the angle ofbending produced by the fingers. More than two buttons may be providedby changing the number of partitions of the sector shaped areas.

Angles into which the original angle is divided internally may not beequal with each other. For example, in consideration of a characteristicthat the smaller an angle of bending produced by a finger is, the easierthe finger can be controlled, the angle of a sector of a button at theupper side of the screen may be set small, and the angle of a sector ofa button at a position nearer to the left or right side of the screenmay be set larger. Instead of the shape of the buttons, the dispositionsof the buttons may be configured so as to suit to the range of movementof the fingers.

FIG. 8 shows a variation of the L1/L2 button input area. Although threebuttons, i.e., an L1 button 88 a, an L2 button 88 b, and an L3 button 88c are provided in the L1/L2/L3 button input area 86 shown in FIG. 8 asan example, the number of the buttons are not limited. On one hand theshape of each button is set independently from each other, on the otherhand, the buttons are laid out so as to form an arc shape. Although inFIG. 8, the shape of each button is set as a circular form, the shapemay be a rectangle or the like. In this manner, even the shape of thebuttons are similar with that of common cases, by arranging buttons inan arc shape, a user can touch buttons without distortion in adistinguishable manner depending on the angle of bending produced by anindex finger. Also in this example, the further the position of a buttonis from the upper side of the screen and the nearer the position is tothe left side, the larger the spacing between the button and an adjacentbutton may be set. The same is applied to buttons at an opposedposition, such as, the R1/R2 button shown in FIG. 7, or the like.

FIG. 9 shows another exemplary layout of the GUI screen image and acontents screen image. In the embodiment described above, a GUI screenimage is displayed as an on-screen image on a contents screen image. Inthe example shown in FIG. 9, the information processing device 10 isused while oriented vertically long, and a contents screen image 100 anda GUI screen image 102 are displayed at separate areas. Also in thiscase, the information processing device 10 may be configured in asimilar manner as shown in FIG. 3, and the image synthesizing unit 34performs synthesis by rendering the contents image and the GUI image inseparate predetermined areas, respectively. Operation methods of avariety of types of GUIs are also implemented in a similar manner asdescribed above.

In this case, although the area size for displaying the contents screenimage 100 becomes smaller, an GUI screen image does not hide thecontents screen image 100, thus the directional keys input area, thebutton input area, the joystick input area, or the like may be displayedconcurrently without serious inconvenience. Further, this case has ahigh probability that the shape of a hand holding the device and/or athumb or a finger that operates the input areas differ from the casedescribed above. Therefore, the L1 button, the L2 button, the R1 buttonand the R2 button may not be a circle sector shape, arranged in an arcshape, or the like.

The information processing device 10 is configured so that a user candefine whether to use the device 10 while orienting vertically long, ororienting horizontally long by taking into account the type of contents,the type of a game, or the like. FIG. 10 shows an exemplaryconfiguration screen image of the display mode of the GUIs. A GUIconfiguration screen image 90 is set so that, whichever before startingthe processing of contents or in the middle of the process, a user cancall the GUI configuration screen image 90 anytime by touching apredetermined button of a GUI, and the GUI configuration screen image 90is displayed as an additional on screen display. Alternatively, a menuscreen may be called first, and then the GUI configuration screen image90 may be called by selecting from the menu.

The GUI configuration screen image 90 includes a configuration detaildisplaying field 92, a transmission factor defining bar 94, and anok/cancel button 96. The configuration detail displaying field 92displays the details of a configuration, such as: a) the orientation ofthe information processing device 10; b) a mode setting whether thejoystick input area 58 is switched with the directional keys input area42 and/or the button input area 44, or the joystick input area 58 isregularly displayed; c) whether or not a circle displayed in thedirectional keys input area 42 and/or the button input area 44 isdisplayed in a partially translucent manner, and the color of thecircle; or the like. The transmission factor defining bar 94 defines thetransmittance of the circle in case the circle is displayed in apartially translucent manner. The ok/cancel button 96 allows a user toconfirm the detail of configuration or to cancel a change ofconfiguration.

In the example of the configuration detail displaying field 92 shown inFIG. 10, a configuration is defined wherein the information processingdevice 10 is used while oriented horizontally long, and a mode isadopted wherein the joystick input area 58 is switched with thedirectional keys input area 42 and/or the button input area 44, and thecircles included in the GUIs are set so as to be displayed in apartially translucent manner.

By calling the GUI configuration screen image 90 when a user would liketo change a configuration and by touching the direction instructionbutton 98 displayed in the configuration detail displaying field 92 foreach item, the current configuration that has been displayed is switchedto displaying of another candidate. If a desired configuration isdisplayed, the user confirms the configuration by touching the OK buttonincluded in the ok/cancel button 96. In case of displaying the circlesin a partially translucent manner, the user also adjusts thetransmission factor defining bar 94 as appropriate.

In this manner, by allowing a user to easily change the configuration ofthe display mode of a GUI, the information processing device can beoperated in an optimal environment in accordance with the type ofcontents, the details or a scene of a game, or the like, and inaccordance with the preference of individual users. Therefore, even whenthe device is oriented horizontally long, the directional keys inputarea 42, the button input area 44, and the joystick input area 58 can beconcurrently displayed easily, or the shape of the L1/L2 button inputarea 80 and the R1/R2 button input area 82 can be set as a rectangle,easily.

According to the embodiment described above, a GUI screen image isdisplayed as an on-screen display on a display screen of the informationprocessing device. The GUI displayed in this process is a twodimensional representation of directional keys, a variety of types ofbuttons, a joystick or the like that have been formed threedimensionally as a conventional controller of a game device. In thismanner, even a user who gets used to using a three dimensionalcontroller, can operates easily with a similar operation means andsimilar operability.

The image of each GUI is disposed near a corner of the screen so thatthe area of a hidden region in an output image of contents becomessmall. In addition, by providing a combined GUI area, and by enablingswitching to individual GUIs depending on which GUI's graphic includes apoint from which contact by a user is started, a same detection area isshared by a plurality of GUIs. Further a GUI, which can readily call aGUI that is basically defined as a non-displayed GUI, is provided. Bythese characteristics, a contents screen image and a GUI screen imagecan coexist naturally.

As a mode for providing a combined GUI area, a graphic of a joystick isprovided in a central portion of a graphic configured with directionalkeys or four buttons, and by sliding a thumb or a finger from a point inthe central portion where contact is started, an input of an arbitrarydirection and an arbitrary quantity can be implemented. Such continuousmotion resembles a manipulation of putting a thumb or a finger on astick of an original joystick input device and tilting the stick, thusbrings less discomfort to a user in switching of GUIs or in operation.

Further, disposing GUIs at the lower left, at the lower right, at theupper left, and at the upper right on a screen image in correspondencewith the positions of thumbs and fingers that hold the informationprocessing device enables a natural operation using thumbs and/or indexfingers of both hands. In addition, forming a plurality of buttonsdisposed at the upper left and at the upper right, which are likely tobe operated by index fingers, as continuous circle-sector-shaped area,or by disposing the plurality of buttons in an arc shape while takingthe range of movement of index fingers into account, a user can touchthe buttons in a distinguishable manner without distortion.

By allowing a user to configure the orientation of the informationprocessing device, whether or not to switch GUIs, or whether or not todisplay a part of an image constituting a GUI in a partially translucentmanner, an operation environment that agrees with the type of contents,the preference of a user, or the like can be readily implemented.

Given above is an explanation based on the exemplary embodiments. Theseembodiments are intended to be illustrative only and it will be obviousto those skilled in the art that various modifications to constitutingelements and processes could be developed and that such modificationsare also within the scope of the present invention.

DESCRIPTION OF REFERENCE SYMBOLS

10 information processing device, 12 touch panel, 14 display, 16contents storage, 18 GUI image storage, 20 input/output control unit, 22operation information converting unit, 24 contents processing unit, 26GUI image generating unit, 28 GUI image buffer, 30 contents imagegenerating unit, 32 contents image buffer, 34 image synthesizing unit,50 a GUI screen image, 52 first combined GUI area, 53 GUI of joystick,54 switching button, 56 second combined GUI area, 58 joystick inputarea, 64 a detection area, 66 a overlapping area, 70 indicator, 79detection area, 80 L1/L2 button input area, 82 R1/R2 button input area,86 L1/L2/L3 button input area, 90 GUI configuration screen image, 92configuration detail displaying field, 94 transmission factor definingbar.

The invention claimed is:
 1. An input device comprising: a displaydevice placed with an information processing device in a housing in anintegrated fashion; and a touch panel covering the display, the inputdevice converting information on a point of contact with a finger orthumb of a hand that is detected by the touch panel into an operationmade by a user and allows the information processing device to processthe operation, wherein: the display device displays a GUI (GraphicalUser Interface) screen image for user input operation as an on-screendisplay, wherein the GUI screen image includes at least a first GUIgraphic and a second GUI graphic, representing at least a first GUIoperation area and a second GUI operation area, and an output imagegenerated as a result of information processing performed by theinformation processing device, such that a first GUI display mode isprovided when the housing is in a vertically long orientation and asecond GUI display mode is provided when the housing is in ahorizontally long orientation, the first GUI display mode provides theGUI screen image for user input operation and the output image inseparate, non-overlapping areas of a display screen, the second GUIdisplay mode provides the GUI screen image for user input operation byat least partially overlapping the GUI screen image and the output imageon the display screen, and respective GUI graphics being disposed in theGUI screen image in correspondence with a position of an index fingerand a thumb of a user when the user holds the housing from both sides sothat an index finger and a thumb are placed on the upper surface of thedisplay device, opposite a middle finger that supports the housing fromunderneath, at least one of the GUI operation areas included in the GUIscreen image in the second GUI display mode is a combined GUI image areaformed by combining at least first and second GUI graphics representingat least first and second GUI operation areas, respectively, from theGUI screen image in the first GUI display mode, wherein: (i) the secondGUI graphic includes a directional keys graphic that corresponds to thesecond GUI operational area, which includes directional keys, wherein aplurality of direction instruction keys are disposed on thecircumference of a circle, (ii) the first GUI graphic includes ajoystick graphic that corresponds to the first GUI operational area,which includes a pseudo-joystick receiving an input of an arbitrarydirection and an arbitrary quantity, and (iii) the joystick graphic isdisposed at the center of the directional keys graphic in the combinedGUI image area, when the user selects the first GUI graphic within thecombined GUI image area, the first GUI graphic representing the firstGUI operation area is displayed in place of the combined GUI image area,and when the user selects the second GUI graphic within the combined GUIimage area, the second GUI graphic representing the second GUI operationarea is displayed in place of the combined GUI image area.
 2. The inputdevice according to claim 1, wherein, in the second GUI display mode,among the GUI operation areas, a GUI operation area disposed at theposition of an index finger has a circle sector shape that correspondsto a range of movement of an upper part from a joint of the indexfinger.
 3. The input device according to claim 2, wherein the GUIoperation area disposed at the position of the index finger receives anindividual input for each of a plurality of circular sector shaped areasformed by internally dividing the center angle of the circle sector. 4.The input device according to claim 3, wherein the plurality of circularsector shaped areas are formed so that the smaller an angle of bendingproduced by the index finger that operates an area is, the smaller thecenter angle of the area is.
 5. The input device according to claim 1,wherein, in the second GUI display mode, among the GUI operation areas,a GUI operation area displayed at the position of an index finger is aGUI graphic including a plurality of buttons laid out so as to form anarc shape that corresponds to a range of movement of an upper part froma joint of the index finger.
 6. The input device according to claim 5,wherein the plurality of buttons are laid out so that the smaller anangle of bending produced by the index finger that operates a button is,the larger the spacing between the button and an adjacent buttons is. 7.The input device according to claim 1, wherein, in the second GUIdisplay mode, among the GUI operation areas, a GUI operation areadisposed at the position of a thumb is an operating buttons graphicwhere a plurality of buttons are disposed on a circumference of afurther circle.
 8. The input device according to claim 7, whereincircles corresponding to the circumferences are displayed in a partiallytranslucent manner for the directional keys graphic and the operatingbuttons graphic, respectively.
 9. The input device according to claim 7,wherein the GUI operation area for specifying the direction keys graphicdetects an operation made on each direction instruction key by adetection area surrounding the direction keys graphic of the directioninstruction key, and an area where detection areas for adjacentdirection instruction keys overlap with each other is defined as andetection area for an operation in a direction between the twodirections corresponding to the adjacent direction instruction keys. 10.An information processing device comprising: an information processingunit operative to perform information processing in accordance with anoperation made by a user; a display device operative to display anoutput image generated as a result of information processing performedin the information processing device, the upper surface of the displaydevice being covered by a touch panel; and a housing operative to storethe information processing device and the display device in anintegrated fashion, wherein: the display device displays a GUI(Graphical User Interface) screen image for user input operation as anon-screen display, wherein the GUI screen image includes at least afirst GUI graphic and a second GUI graphic, representing at least afirst GUI operation area and a second GUI operation area, and an outputimage generated as a result of information processing performed by theinformation processing device, such that a first GUI display mode isprovided when the housing is in a vertically long orientation and asecond GUI display mode is provided when the housing is in ahorizontally long orientation, the first GUI display mode provides theGUI screen image for user input operation and the output image inseparate, non-overlapping areas of a display screen, the second GUIdisplay mode provides the GUI screen image for user input operation byat least partially overlapping the GUI screen image and the output imageon the display screen, and respective GUI graphics being disposed in theGUI screen image in correspondence with a position of an index fingerand a thumb of a user when the user holds the housing from both sides sothat an index finger and a thumb are placed on the upper surface of thedisplay device, opposite a middle finger that supports the housing fromunderneath, at least one of the GUI operation areas included in the GUIscreen image in the second GUI display mode is a combined GUI image areaformed by combining at least first and second GUI graphics representingat least first and second GUI operation areas, respectively, from theGUI screen image in the first GUI display mode, wherein: (i) the secondGUI graphic includes a directional keys graphic that corresponds to thesecond GUI operational area, which includes directional keys, wherein aplurality of direction instruction keys are disposed on thecircumference of a circle, (ii) the first GUI graphic includes ajoystick graphic that corresponds to the first GUI operational area,which includes a pseudo-joystick receiving an input of an arbitrarydirection and an arbitrary quantity, and (iii) the joystick graphic isdisposed at the center of the directional keys graphic in the combinedGUI image area, when the user selects the first GUI graphic within thecombined GUI image area, the first GUI graphic representing the firstGUI operation area is displayed in place of the combined GUI image area,and when the user selects the second GUI graphic within the combined GUIimage area, the second GUI graphic representing the second GUI operationarea is displayed in place of the combined GUI image area, and theinformation processing unit converts information on a point of contactwith a finger or thumb of a hand on the GUI that is detected by thetouch panel into an operation made by a user and performs informationprocessing.
 11. An input value acquiring method comprising: providing adisplay device with an information processing device in a housing in anintegrated fashion and a touch panel covering the display; convertinginformation on a point of contact with a finger or thumb of a hand thatis detected by the touch panel into an operation made by a user;allowing the information processing device to perform informationprocessing in accordance with the operation; displaying a GUI (GraphicalUser Interface) screen image for user input operation as an on-screendisplay, wherein the GUI screen image includes at least a first GUIgraphic and a second GUI graphic, representing at least a first GUIoperation area and a second GUI operation area, and an output imagegenerated as a result of information processing performed by theinformation processing device, such that a first GUI display mode isprovided when the housing is in a vertically long orientation and asecond GUI display mode is provided when the housing is in ahorizontally long orientation, wherein: the first GUI display modeprovides the GUI screen image for user input operation and the outputimage in separate, non-overlapping areas of a display screen, the firstGUI display mode provides the GUI screen image for user input operationand the output image in separate, non-overlapping areas of a displayscreen, the second GUI display mode provides the GUI screen image foruser input operation by at least partially overlapping the GUI screenimage and the output image on the display screen, and respective GUIgraphics being disposed in the GUI screen image in correspondence with aposition of an index finger and a thumb of a user when the user holdsthe housing from both sides so that an index finger and a thumb areplaced on the upper surface of the display device, opposite a middlefinger that supports the housing from underneath, at least one of theGUI operation areas included in the GUI screen image in the second GUIdisplay mode is a combined GUI image area formed by combining at leastfirst and second GUI graphics representing at least first and second GUIoperation areas, respectively, from the GUI screen image in the firstGUI display mode, wherein: (i) the second GUI graphic includes adirectional keys graphic that corresponds to the second GUI operationalarea, which includes directional keys, wherein a plurality of directioninstruction keys are disposed on the circumference of a circle, (ii) thefirst GUI graphic includes a joystick graphic that corresponds to thefirst GUI operational area, which includes a pseudo-joystick receivingan input of an arbitrary direction and an arbitrary quantity, and (iii)the joystick graphic is disposed at the center of the directional keysgraphic in the combined GUI image area, when the user selects the firstGUI graphic within the combined GUI image area, the first GUI graphicrepresenting the first GUI operation area is displayed in place of thecombined GUI image area, and when the user selects the second GUIgraphic within the combined GUI image area, the second GUI graphicrepresenting the second GUI operation area is displayed in place of thecombined GUI image area.
 12. A non-transitory computer-readablerecording medium containing a computer program, the computer program forinteroperating with an information processing device having a displaydevice, a touch panel covering the display device, and a housing in anintegrated fashion, the computer program, when executed by amicroprocessor causes the information processing device to carry outactions, comprising: converting information on a point of contact with afinger or thumb of a hand that is detected by the touch panel into anoperation made by a user; performing information processing inaccordance with the operation, displaying a GUI (Graphical UserInterface) screen image for user input operation as an on-screendisplay, wherein the GUI screen image includes at least a first GUIgraphic and a second GUI graphic, representing at least a first GUIoperation area and a second GUI operation area, and an output imagegenerated as a result of information processing performed by theinformation processing device, such that a first GUI display mode isprovided when the housing is in a vertically long orientation and asecond GUI display mode is provided when the housing is in ahorizontally long orientation, wherein: the first GUI display modeprovides the GUI screen image for user input operation and the outputimage in separate, non-overlapping areas of a display screen, the secondGUI display mode provides the GUI screen image for user input operationby at least partially overlapping the GUI screen image and the outputimage on the display screen, and respective GUI graphics being disposedin the GUI screen image in correspondence with a position of an indexfinger and a thumb of a user when the user holds the housing from bothsides so that an index finger and a thumb are placed on the uppersurface of the display device, opposite a middle finger that supportsthe housing from underneath, at least one of the GUI operation areasincluded in the GUI screen image in the second GUI display mode is acombined GUI image area formed by combining at least first and secondGUI graphics representing at least first and second GUI operation areas,respectively, from the GUI screen image in the first GUI display mode,wherein: (i) the second GUI graphic includes a directional keys graphicthat corresponds to the second GUI operational area, which includesdirectional keys, wherein a plurality of direction instruction keys aredisposed on the circumference of a circle, (ii) the first GUI graphicincludes a joystick graphic that corresponds to the first GUIoperational area, which includes a pseudo-joystick receiving an input ofan arbitrary direction and an arbitrary quantity, and (iii) the joystickgraphic is disposed at the center of the directional keys graphic in thecombined GUI image area, when the user selects the first GUI graphicwithin the combined GUI image area, the first GUI graphic representingthe first GUI operation area is displayed in place of the combined GUIimage area, and when the user selects the second GUI graphic within thecombined GUI image area, the second GUI graphic representing the secondGUI operation area is displayed in place of the combined GUI image area.13. The input device according to claim 1, wherein the display devicefurther displays a configuration screen image to set which orientationof the housing the user holds, vertically long or horizontally long,when the user requests for the display, and switches positionalrelationship between the output image and the GUI screen according tothe user's setting to the configuration screen.
 14. The input deviceaccording to claim 1, wherein a first number of GUI operation areas isincluded in the GUI screen image in the first GUI display mode, a secondnumber of GUI operation areas is included in the GUI screen image in thesecond GUI display mode, and the first number is different from thesecond number.
 15. The input device according to claim 1, wherein atleast one of the GUI operation areas of the GUI screen image in thefirst GUI display mode is of a differing shape as compared to acorresponding at least one of the GUI operation areas of the GUI screenimage in the second GUI display mode.